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Abstract. We prove that a polar orthogonal representation of a real reductive algebraic 
group has the same closed orbits as the isotropy representation of a pseudo-Riemannian 
symmetric space. We also develop a partial structural theory of polar orthogonal repre- 
sentations of real reductive algebraic groups which slightly generalizes some results of the 
structural theory of real reductive Lie algebras. 



1. Introduction 

A representation of a complex reductive algebraic group G on a finite-dimensional complex 
vector space V is called polar if there exists a subspace c C V consisting of semisimple 
elements such that dime = dim V//G (the categorical quotient), and for a dense subset of c, 
the tangent spaces to the orbits are parallel |DK85j ; then it turns out that every closed orbit of 
G meets c (Prop. 2.2, loc. cit). The class of polar representations was introduced and studied 
by Dadok and Kac in [DK85] , and it is very important in invariant theory because it includes 
the adjoint actions, the representations associated to symmetric spaces studied by Kostant 
and Rallis |KR71] as well as, more generally, the representations associated to automorphisms 
of finite order (^-groups) introduced by Vinberg |Vin76j (see also |Kac80j). At present, there 
is no complete classification of polar representations although the paper [DK85j contains 
very important partial results. 

A complex (resp. real) representation admitting a complex-valued (resp. real-valued) in- 
variant non-degenerate symmetric bilinear form is called orthogonal. It is well known that 
a complex orthogonal representation admits a real form invariant under a maximal com- 
pact subgroup. Consider in particular the complex polar orthogonal representations and the 
class of compact real forms they originate. Since the complex reductive algebraic groups 
are exactly the complexifications of the compact Lie groups, one can equivalently define 
directly the concept of a real polar representation of a compact Lie group in the differential- 
geometric setting (as in e.g. [PT87j ) and obtain the same class. Note that orbits of polar 
representations of compact Lie groups are very important in submanifold geometry and 
Morse theory [ES581 IUon711 IS^eM IPT871 IDUOll IGT03j . Now, such representations were 
classified by Dadok in |Dad85] , and the following very nice characterization was deduced: A 
polar representation of a compact Lie group has the same orbits as the isotropy representation 
of a Riemannian symmetric space. 

The purpose of this paper is to study non-compact real forms of complex polar orthogonal 
representations. Equivalently, we define a representation of a real reductive algebraic group 
(in the sense of [BH62, §1]) to be polar if and only if its algebraic complexification is polar. 
In section [3] we prove the following theorem. 
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Theorem 1. A polar orthogonal representation of a connected real reductive algebraic group 
has the same closed orbits as the isotropy representation of a pseudo-Riemannian symmetric 
space. 

In section [H we discuss some aspects of the submanifold geometry of the closed orbits of 
the polar orthogonal representations of the real reductive algebraic groups in that we relate 
them to a notion of pseudo-Riemannian isoparametric submanifold of a pseudo-Euclidean 
space (compare |Hah84l Mag85|). 



Finally in section El independently of classification results, we develop a partial structural 
theory of polar orthogonal representations of real reductive algebraic groups that general- 
izes some results of the structural theory of real reductive Lie algebras. In this regard, 
we propose to replace adjoint actions by polar orthogonal ones. The results we prove are 
slight generalizations of well known results for the adjoint actions, but we believe our proofs 
are more geometric. In particular, we show that a polar orthogonal representation of a 
real reductive algebraic group admits finitely many pairwise inequivalent so called Cartan 
subspaces in standard position with respect to a compact real form such that the union 
of those subspaces meets all the closed orbits and always orthogonally (Theorem [15] and 
Corollary [T8l) . We also construct the so called Cayley transformations that relate different 
equivalence classes of Cartan subspaces ( §5.3|) . and use those to show that the equivalence 
classes of Cartan subspaces in the two extremal positions with respect to the compact real 
form are unique (Corollary 1221) . 

Unless explicit mention to the Zariski topology is made, we use throughout the classical 
topology. We always use lowercase gothic letters to denote Lie algebras. For a given ho- 
momorphism of groups, we denote the induced homomorphism on the Lie algebra level by 
the same letter whenever the context is clear. Sometimes it is useful to call a representation 
orthogonalizable if it admits an invariant non-degenerate symmetric bilinear form but we do 
not want to fix such a form. 

Part of this work was completed while the first author was visiting University of Sao Paulo 
for which she would like to thank CNPq and CCInt-USP for their generous support, and 
part of it was completed while the second author was visiting Universita di Roma 2 "Tor 
Vergata" for which he would like to thank INdAM for its generous support. The second 
author also wishes to thank Ralph Bremigan and Martin Magid for very useful discussions. 



2. Preliminaries 

Let G be a connected complex reductive algebraic group. Let r : G — > GL(V) be a 
complex representation. A vector v G V is called semisimple if the orbit Gv is closed. Not 
every orbit of G in V is closed, but the closure of any orbit contains a unique closed orbit. 
An element is called regular if it is semisimple and dimGv > dimGx for all semisimple 
x e V. The representation r is called stable or is said to admit generically closed orbits if 
there exists an open and dense subset of V consisting of closed orbits. An orthogonalizable 
representation is necessarily stable (see [Sch80, Cor. 5.9] or |Lun72| ILun73| ). 

Let C[V] be the polynomial algebra of V, and let C[V] G be the algebra of G-invariant 
polynomials. It does not contain nilpotents, and is finitely generated by a theorem of Hilbert, 
so it is the coordinate ring of an affine algebraic variety denoted by V//G and called the 
categorical quotient of V by G. The embedding Cf^]* 9 — > C[V] induces a surjective morphism 
of affine algebraic varieties n : V — > V//G. Every fiber of n contains a unique closed orbit. 
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It follows that V//G can be seen as the parameter set of closed G-orbits in V, and then tt(v) 
represents the unique closed orbit in the closure of Gv |PV94t §4]. 
For semisimple v G V, set 

c v = {x EV \ Q ■ x C Q - v}. 

Then c v consists entirely of semisimple elements, and the isotropy subalgebras satisfy g x D Q v 
for x G c v |DK85l Lem. 2.1]. The representation r is called polar if a semisimple v can be 
chosen so that dimc„ = dimV//G. In this called a Cartan subspace. The Cartan 

subspaces of a polar representation are all G-conjugate |DK85l Thm. 2.3]. 

The group G can be seen simply as the complexification of a compact connected Lie group 
U; compare }Sch80l §5] or }BH621 Rmk. 3.4]. Then U is a maximal compact (necessarily 
connected) subgroup of G, and every maximal compact subgroup of G is G-conjugate to 
U. It is easy to see that a representation r is orthogonalizable if and only if it admits 
a real form t u : U — > GL(W) [Sch80l Prop. 5.7]. The group U must be the fixed point 
group G e of a unique anti-holomorphic involutive automorphism 9 of G, which is called a 
Cartan involution of G. Also, the subspace W is the fixed point set V e of a conjugate-linear 
involutive automorphism 9 of V, the equation 9(g ■ v) = 9(g) ■ 9{y) holds for g G G and 
v G V, and an invariant form (-, •) can be chosen on V so that it is real- valued on V 6 . 

More generally, we consider real forms of r : G — > GL(V) given by a pair (a, 5") where a 
is an anti-holomorphic involution of G and a is a real structure on V satisfying a(g ■ v) = 
a(g) • a(v) for g G G, v G V. The fixed point subgroup G u is a (not necessarily connected) 
real reductive algebraic group, and r of course restricts to a representation of G a — > GL(V a ), 
where V a is the fixed point set of a in V. We say that two real forms (a, a) and (cr', 5"') 
commute if they commute componentwise. If r is orthogonal with respect to (•, •) and a real 
form (cr, cr) is given, then (•, •) is said to be defined over R with respect to cr and (o~,a) is 
called an orthogonal real form if (•, •) is real-valued on V° ' . Note that the latter condition is 
equivalent to having 

{ax, ay) = (x,y) 

for x, y G V. A Cartan pair of r is an orthogonal real form (9, 9) such that 9 is a Cartan 
involution of G and (■,■) is real-valued and negative-definite on V e . Note that (9,9) is a 
Cartan pair of r with respect to (•, •) if and only if (9, —9) is a Cartan pair of r with respect 
to — (•, •). The following result is essentially proved in |Bre93l 7.4], but we find it convenient 
to include a proof here because we will need to refer to some of its techniques. 

Proposition 2 (Bremigan). Let r : G — > 0(V, (•,•)) be an orthogonal representation, and 
suppose that (a, a) is an orthogonal real form. Then there exists a Cartan pair (9, 9) which 
commutes with (a, a) . 

Proof. It is well known that there exists a Cartan involution 9 of G such that 9a = a9. 
Let U = G e be the associated maximal compact subgroup of G. Consider the realification 
V r of V, and denote the invariant complex structure on V r by J so that V = (V r , J). Note 
that 

^T(g)a^ = r(a(g)), Jr(g)J~ l = r(g) and JaJ' 1 = -a 

for g G G. Let G* be the subgroup of GL(V r ) generated by t(G), a and J. Then G* contains 
t(G) as a normal subgroup of finite index. Due to 9a = a9, we have also that a normalizes 
t(U). Let U* be the subgroup of G* generated by r(U), a and J. Then U* is a compact 
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subgroup of G*, so we can find an [/^-invariant positive-definite real inner product on V r 
which we denote by Set 

(x,y) = x-y + i(x- Jy) 

for x, y G V r . Then it is easily checked that (*, •) is an [/-invariant positive-definite Hermitian 
form on (V r , J) = V which is real-valued on V a '. In particular, iu acts on V by Hermitian 
endomorphisms. Next, define a conjugate-linear automorphism 9 of V by setting 

(1) (x,0y) = -(x,y) 
for x, y G V. Then 

(2) (x,9(gy)) = -(x,gy) = -(g- x x,y) = (g- l x,~9y) = (x,9(g)9(y)), 
so Or{g) = r{9{g))9 for g G G. Moreover 

(3) (x, 9ay) = - (x, ay) = - (era;, y) = (ra, 0y) = (x, a%) 
implying that 9a = a9. We also have that 

~2 ~2 ~ — ~ 

(9 x,y) = (y,9 x) = -(y,9x) = -(9x,y) 
= (9x,9y) = (9y,9x) = --- 
= (x, 9 y) 

for x, y G V. It follows that 9 2 : V — >• V is a G*-equivariant C-linear Hermitian automor- 
phism. Hence there exists a (•, •)- and (■, -)-orthogonal G*-invariant decomposition V = @jVj 

~2 

such that 9 \y o = \ id^ where Xj G R \ {0} and the Ay's are pairwise distinct. 

Note that Xj(x,x) = (9x, 9x) > if x G Vj \ {0}, so we also have Xj > 0. If we change 
(-, •) by a factor of X 1 ^ 2 on Vj x Vj, as we do, 9 is changed by a factor of A" 1 ^ 2 on Vj, and 

then the resulting 9 satisfies 9 = idy. Note that equations (J2J) and (J3J) are unchanged. Now 
(9, 9) is a real form of (G, V) commuting with (a, a). Further, 

(Ox, By) = -(9x,9 2 y) = -(9x,y) = ~{y,9x) = (y,x) = (x,y) 
for x, y G V and 

(x,x) = —(x,9x) = —(x,x) < 
for x G V e \ {0}. This completes the proof. □ 

Proposition 3. Let t : G —>■ 0(V, (•, ■)) be an orthogonal representation, and suppose that 9 
is a Cartan involution of G. Then there can be at most one real structure 9 on V such that 
(9, 9) is a Cartan pair of t. 

Proof. Suppose that (9, 9) and (9, 9 ) are two Cartan pairs of r. Define 
h(x,y) — —(x,9y) and h'(x,y) = —(x,9 y) 

for x, y G V. It is easy to see that h and h! are two [/-invariant positive-definite Hermitian 
forms. Diagonalizing h! with respect to h, we get a [/-invariant, /i-orthogonal splitting 
V = ®jVj such that 9 = Xj9 on Vj, where Xj > and the A/s are pairwise distinct. Using 
[9'f = 9 2 = 1, we finally see that o' = 9. □ 
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Corollary 4. Let r : G — > 0(V, (•, •)) fre an orthogonal representation. Then any two Cartan 
pairs of r are G-conjugate; moreover, if the underlying Cartan involutions commute with a 
real form a of G, then the Cartan pairs are (G a )° -conjugate. 

Proof. Let (#i,#i) and (62,02) be two Cartan pairs of r. It is known that there exists 
g E G such that 62 = Inn^Inn" 1 . Of course, (Inn s 0]Inn~ , gOig' 1 ) is also a Cartan pair. 
Proposition [3] implies that 62 = gQ\g~ x . Further, if both 9\ and 82 commute with a, it is 
known that g can be taken in the identity component of G a . □ 

3. The classification 

Let Gr/Gr be a semisimple pseudo-Riemannian symmetric space. Here Gr is a connected 
real semisimple Lie group, f is a non-trivial involutive automorphism of Gr and Gr is an 
open subgroup of the fixed point group of f. The automorphism f induces an automorphism 
of the Lie algebra jjr of Gr which we denote by the same letter. Let 0r = gR + Vr be 
the decomposition into ±l-eigenspaces of f . Of course, £)r is the Lie algebra of Gr. The 
restriction of the Killing form of $Jr to Vr x Vr is Ad GR -invariant and non-degenerate, so it 
induces a GR-invariant pseudo-Riemannian metric on Gr/Gr. The adjoint action of Gr on 
Vr is equivalent to the isotropy representation of Gr/Gr at the base-point. 

Next, extend f complex-linearly to an automorphism of the complexification g = (q-rY 
denoted by the same letter and consider the corresponding decomposition Q = Q + V into 
±l-eigenspaces. Let G be the simply-connected complex Lie group with Lie algebra g, view f 
as an involution of G, and let G be the fixed point group of f in G. Note that G is connected. 
The adjoint action of G on V is a complex polar action whose Cartan subspaces coincide 
with the maximal Abelian subspaces of V consisting of semisimple elements (indeed, this is 
a #-group (see |DK85j Introd.] or [PV941 8.5, 8.6]; no relation here to the aforementioned 
Cartan involution 6). Further, it is an orthogonal action with respect to the restriction of 
the Killing form of g to V. By passing from Gr to a finite covering if necessary, we may 
assume that Gr embeds into G and Gr embeds into G, so we can view the adjoint action of 
Gr on Vr as an orthogonal real form of the adjoint action of G on V. We deduce that the 
isotropy representation of a pseudo-Riemannian symmetric space is a polar representation. 
In this section, we prove Theorem [T] which is essentially a converse to this result. 

Before giving the proof of Theorem [TJ we prove four lemmas. In the remaining of this 
section, let G be a complex reductive algebraic group defined over R and denote by Gr the 
identity component of its real points. 

Lemma 5. Let t : G —>■ GL(V) be a polar representation, where V = V"i©V2 is a G-invariant 
decomposition. Assume that the induced representations Ti : G — > GL(Vj) are stable. Then: 

(a) Ti is polar, i = 1, 2. 

(6) Every Cartan subspace of r is of the form c = c\ © c-i, where Ci is a Cartan subspace 
ofn, i = l,2. 

(c) The closed orbits of G on V 2 coincide with those of G Vl , where V\ is any semisimple 
vector of V\ . In particular, V\ and V2 are inequivalent representations. 

(d) Fix a Cartan subspace c = c\ © c 2; let f) 1 (resp. \) 2 ) denote the centralizer of c 2 
(resp. ci) in q, and denote by Hi the connected subgroup of G corresponding to f)j. 
Then the closed orbits of r coincide with those of t : Hi x if 2 ~~ * GL(Vi © V2), where 
T(gi,g2)(vi +v 2 ) = Ti{gx)vi + T2(g 2 )v 2 . 

5 



Proof. Parts (a) and (b) are Prop. 2.14 in [DK85| . and (c) is Cor. 2.15 of that paper. Let 
us prove (d). Select a regular element v x + v 2 G c\ © c 2 for r. Then \) x = q V2 , rj 2 = Q Vl and 
(c) implies that \j x ■ v\ = g-vi and t) 2 • v 2 = g ■ v 2 (note that Vi is semisimple for Tj since q is a 
Cartan subspace). This implies that g = § 1 + f) 2 , so G = i?i • H 2 = H 2 ■ Hi by connectedness 
of G. For any u% + w 2 G c\ © c 2 , we now have that G(«i + w 2 ) C (H% x H 2 )(ui + w 2 ). Since 
g = f)j + f) 2 , and G(«i + u 2 ), H\U\ x if 2 'u 2 are closed and connected, it follows that the two 
orbits coincide. □ 

Lemma 6. Let p : Gr — > GL(Vr) be a polar representation, where Vr = (Vr)i © (Vr) 2 is a 
G\\-invariant decomposition. Assume that the induced representations pi : Gr — > GL((Vji)i) 
are orthogonalizable. Then there exist closed connected subgroups H[ of Gn, i — 1, 2, such 
that the restricted representations Pi\n'. '■ H- — > GL((VRji) are polar and the closed orbits 
of p coincide with those of p : H[ x H' 2 — > GL((Vr)i © (Vr,) 2 ), where p(gi,g 2 )(vi + v 2 ) = 

Pi (gi)vi + p2(g2)v 2 . 

Proof. The complexification r = p c : G — > GL(V) is polar and each r, = is or- 
thogonalizable, hence stable. By Lemma the closed orbits of r coincide with those of 
f : Hi x H 2 GL{V X © V 2 ), where Vi = (Vr,)!, the group Hi (resp. if 2 ) is the connected 
centralizer of c 2 (resp. Ci) in G, and c = c x © c 2 C V\ © V 2 is a Cartan subspace of r. 
As usual, suppose that p is defined by (a, a) . Now c can be taken to be a-stable due to 
Lemma [131 below. In this case, Hi is cr-stable; set H[ to be subgroup of Gr given by the 
identity component of {Hi)° '. It is clear that the groups H[ have the desired properties. □ 

Given a representation p : Gr — > GL(Vr), denote by p* : Gr — > GL(Vr*) the dual 
representation. Note that p © p* : Gr — > GL(Vr © Vr*) is always orthogonal with respect to 

(4) ((v h V*i), (V2, v* 2 )} = vl(v 2 ) + v* 2 (vi). 

The proof of the following lemma is simple and we omit it. 

Lemma 7. Let p : Gr — > GL(Vr) be orthogonalizable. Then there exists an irreducible 
decomposition 

Vr = (Vr)i © • • • © (Vr), © (VrWi © (Vk); +1 © • • • © (V n ) s © (V R ):, 
where (Vr)i, . . . , (Vr),. are orthogonalizable and (VR,) r+ i, . . . , (Vr) s are not orthogonalizable. 

The following lemma will be used to show that certain polar representations have the same 
closed orbits as a the isotropy representation of a symmetric space. 

Lemma 8. Suppose r : G — > GL(V) is a polar orthogonalizable representation, U is a 
maximal compact subgroup of G and t u : U — > GL(W) is a real form. Suppose also that U' 
is a connected closed subgroup of U and G 1 C G is the complexification of U' . If t u \w has 
the same orbits in W as t u , then t\g> has the same closed orbits in V as t. If, in addition, 
P '■ Gr — > GL(Vr) is a real form of t and G' R C Gr is a connected real form of G' , then 
p\c' YL has the same closed orbits in Vr as p. 

Proof. The assertion about p immediately follows from that about r and the facts that 
Grw is closed if and only if Gv is closed |Bir71] and diniRGRf = dimGv for v G Vr. Let us 
prove the assertion about r. We first claim that if v G V and Gv is closed, then G'v = Gv. 
Of course, we already have that G'v C Gv. In the case in which v G W, we have that both 
Gv and G'v are connected, closed and have dimension equal to dim R Uv = dimnll'v , so the 
result follows. In the general case, fix a [/-invariant positive-definite Hermitian form (•, •) 
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and choose v\ G Gv of minimal length [DK85, p. 508]. Of course, Gv\ = Gv and v\ is also of 
minimal length in G'v\. It follows that G'v\ is also closed [DK85, Thm. 1.1] and G Vl , G' v 
are ^-stable, where 9 is the Cartan involution of G associated to U [DK85J Prop. 1.3]. Let 
L = {G vi ) e and L' = (G' ) . Now we can choose w G W such that U w = L by the same 
argument as in [Sch80, Prop. 5.8], and it easily follows that U' w = V . We have established 
that U w (resp. U' w ) is a real form of G Vl (resp. G'). Therefore 

dim Gv i = dim G — dim G Vl 
= dim R £7 - dim R U w 
= dim R Uw 
= dim R U'w 
= dim-^U' - dim R l^ 
= dim G' — dim G' v 
= dimG'fi, 

which implies that G'v\ = Gv\. Since Gv± = Gv, we also have G'v = Gv, proving the claim. 

Let c C V be a Cartan subspace of r. In view of the claim proved above, c consists of 
semisimple elements of t\g>- Also, dime = dim V//G = divnV //G' , where the last equality 
follows from the fact that t u and t u \u> have the same co-homogeneity in W. By [DK85, 
Prop. 2.2], every closed G"-orbit meets c, from which it follows that t\g> has the same closed 
orbits in V as r. □ 

In order to prove Theorem [T], we will use the explicit lists of polar representations of 
compact Lie groups that have been obtained in |EH99j (irreducible case) and |Ber99l IBerOlj 
(reducible case); see also |GT00j (both cases). For brevity, an isotropy representation of a 



semisimple symmetric space will be called an s-representation. Let p : Gr — * GL(Vr) be 
a polar orthogonal representation. Let r = p c : G — » GL(V), and suppose that p is given 
by (a, a) so that Gr. is the identity component of G a . Let (6, 6) be a Cartan pair as in 
Proposition [2J U = G 9 , W = V 9 , and r u : U — > G J L(W) the associated real form. Then 
r„ is a polar representation of a compact Lie group. By Dadok's theorem quoted in the 
introduction and the results in [EH99, BerOl], r u is either a Riemannian s-representation or 
one of the exceptions listed in those papers. We need the following fundamental lemma. 

Lemma 9. Ifr u is an irreducible Riemannian s-representation, then p is a pseudo-Riemannian 
s-representation. 

Proof. By assumption, u = u + W admits a real Lie algebra structure extending that of u 
such that [HZ961 p. 182] 

[X, w] = t u (X)w and (X, [w, w']) u = (r u (X)w, w') 

for X G u and w, w' G W, where 

(X, Y) u = tracey(adxady) 

for X, Y G u and adx(Z) = [X, Z] for X G u and Z G u. Denote the Killing form of u 
by (3; note that it is nondegenerate as u is semisimple. Also, it turns out that (•, -) u is the 
restriction of j3 to u. 

Now, since /3|vyxvy an d (■,-)\wxW are both positive-definite real- valued symmetric bilinear 
forms which are u-invariant, and r u is irreducible, there exists A > such that f3(x,y) = 



X(x,y) for x, y G W. By C-bilinearity, (3 c (x,y) = \(x,y) for x, y G V, where (3 C is the 
Killing form of u c = g + V. It suffices to prove that 0r := Sr + Vr, is a real subalgebra of u c . 
It is clear that [0r,0r] C gR and [gR, Vr] C Vr. We claim that also [Vr, Vr] C 0r. In fact, 

(5) f3 c (ax, ay) = X(ax, ay) = \{x, y) = X(x, y) = (3 c (x, y) 

for x, y G V . If Zi, Z 2 G g, then also 

(3 c (aZ 1 ,aZ 2 ) = tracer (ad^ad^zj 

= trace s (ad (T Ziad CT z 2 ) + tracey(ad CT Ziad CTZ2 ) 

(6) = trace B (o"adz 1 adz 2 cr) + tracey(aadz 1 adz 2 (5') 

= trace s (adz 1 adz 2 ) + tracei/(adz!adz 2 ) 

= tracer (ad^adzj 

= P C (Z U Z 2 ), 

where we used in the third equality that 

ado-Zi^ = cZi ■ x = a[Z\ ■ ax) = a&dz^x 

for x G V. Therefore 

(3 c (Z,a[x,y])=P c (aZ, [x,y]) 

= (3 c (aZ -x,y) 
= (3 c (a(aZ ■ x),ay) 
= [3 c (Z-ax,ay) 
= (3 C (Z, [ax, ay}) 

for all Z G g and x, y G V. Hence a[x,y] = [ax, ay], proving the claim. Of course, p is 
now the isotropy representation of the pseudo-Riemannian symmetric space Gr/Gr, where 
Gr := Int(gR) and Gr is the connected subgroup associated to gR. □ 

Proof of Theorem [B In view of Lemmas and it is enough to consider the following 

two cases: 

(a) p is irreducible. 

(b) p decomposes as Po©Po> wriere Po : Gr, — > GL(V ) is irreducible and non-orthogonalizable, 
Vr — Vo © Vq, and the inner product on Vr is given by (TjJ. 

(a.l) Suppose first that p is absolutely irreducible. Then r u is an absolutely irreducible 
polar representation of a compact Lie group, so it is either a Riemannian s-representation 
and then the result follows from Lemma [9], or it is listed in [EH99J. In the latter case, it 
must be (SO (3) x Spin(7),R 3 <g> R 8 ), where R 8 denotes the spin representation; accord- 
ing to |Uni04l Table 5, p.79], Gr equals 5O (l,2) x Spin{7) (resp. SO (3) x Spin (3,4), 
5*00(1, 2) x Spino(3, 4); here the subscript denotes the identity component), and p : Gr — > 
GL(R 3 <g> R 8 ) is the tensor product of the standard representation and the spin representa- 
tion. Since Spin{7) C SO{8) and Spin (3,A) C 5O (4,4) [Har90l Thm. 14.2], and p extends 
to a pseudo-Riemannian s-representation p' of 5*00(1,2) x 50(8) (resp. 50(3) x 5O (4, 4), 
5O (l,2) x 5O (4, 4)) on R 3 ® R 8 , it follows from Lemma [S] that p has the same closed 
orbits as p' , so this case is checked. 
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(a. 2) Suppose now that p is irreducible but not absolutely irreducible. Then Vr admits 
an invariant complex structure. 

(a. 2.1) If t u is irreducible, then W admits an [/-invariant complex structure, and by 
Lemma Owe have only to consider the cases in which it is not an s-representation. According 
to |EH99j . those are 

(50(2) x G 2 ,R 2 ©R 7 ) 
(-50(2) x Spin(7), R 2 (g> R 8 ) 

(7) (SU(p) xSU(q), (C?®Cr) (P^q) 

(5[/(n), (A 2 C n ) r ) (nodd) 
(5pm(10),C 16 ) 

We do only the first and third cases, the others being similar in spirit. In the first case, 
Gr must be 5*0(2) x G^, where G% is the automorphism group of the split octonions and 
p is the real tensor product of the standard representation of SO (2) and the 7-dimensional 
representation of G 2 since Vr, admits an invariant complex structure. Now G* 2 C 5*00(3,4) 
and there exists an obvious pseudo-Riemannian s-representation p' of 50(2) x 50o(3, 4) on 
R 2 © R 7 . It follows from Lemma [8] that p and p' have the same closed orbits and we are 
done with this case. In the third case, viewing p as a complex representation, its conjugate 
representation p with respect to Gr must be equivalent to p* because p © p = {r u ) c . The 
only possibility is that p equals (SU(r,p — r) x SU(s,q — s), (C p ©C 9 ) r ), which has the same 
closed orbits as the s-representation of the pseudo-Riemannian symmetric space 

SU(r + s,p + q — r — s) / S{U{r,p — r) x U(s, q — s)). 

(a. 2. 2) If t u is not irreducible, then there exists an [/-irreducible decomposition W = 
Wi © W 2 , where (r u )i : U -» GLiWi) is absolutely irreducible. Now V = W{ © W% is a 
O-irreducible decomposition, where W{ and W£ are inequivalent by polarity (Lemma EH )) 
and W£ must be the conjugate representation to W{ with respect to Gr. Denote Tj = (t u )? : 
G -> GL{W t c ). It follows that 

(8) aWf = WZ and r 2 (g) = r x {a{g)) = ar^a 

for g G G. Since a commutes with 9, we can view a as an automorphism of U . Suppose first 
that t u is splitting, that is U — U\ x [/ 2 and r u is the outer direct product of {t u )i\u 1 and 
( r u)2 \u 2 - O n the level of Lie algebras, ([8]) implies that Ui = ker(r u ) 2 = cr(ker(r„)i) = a(u2). 
Now we can assume that Ui = u 2 , ij u )i = (r u ) 2 , = 0i © 0i, where g x = and g x is the 
conjugate Lie algebra of g 1( and a : q — > g is given by a(Z',Z") = (Z",Z f ). Moreover, 
y = ^ c © W\ and cr: 1/ -> V is given by a« w") = (w",w'). Hence g R = {(Z',Z") G 
g x © 0J : Z' = Z"}, Vr = {(«;', w") G Wf © : = w"}, and p is just the realification of 
the complexification of the real polar absolutely irreducible representation (t u )i\u 1 : U\ — > 
GL(V4 / 1 ). If (t u )i|[/! is an s-representation, this means that p is the s-representation of a 
complex symmetric space viewed as a real representation. The only other possibility is that 
(Oik equals (50(3) x 5pm(7),R 3 © R 8 ). In this case, p : 50(3, C) r x Spin(7, C) r -> 
GL((C 3 ©C 8 ) r ) has the same closed orbits as 50(3, C) r x 50(8, C) r -> GL((C 3 © C 8 ) r ), so 
we are done. Suppose now that r M is not splitting. Then U — U\ X U X [/ 2 , where [/ 2 (resp. [/1) 
coincides with ker(r u )i (resp. ker(r u ) 2 ) up to some discrete part. Since cr(ker(r u )i) = ker(r u ) 2 , 
the automorphism a : U — > U must restrict to isomorphisms U\ — > [/ 2 and [/o — > [/o- It 
follows that [/q is essential for (r w )i if and only if it is essential for (r u ) 2 . Therefore t u is 
not almost splitting in the sense of |GT00l p. 58]; we use the classification given there: due 
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to the facts that the (r u )i admits no invariant complex structure and dimW 7 ! = dimW^, 
we need only to consider the case in which Uq = Spin(8), U± — U2 — {1}, and Wi, W2 
are two 8-dimensional inequivalent representations of Spin(8). Referring to [Oni04, Table 5, 
p. 80], Gr, must be either Spin (3, 5) or Spin (l,7), and p must be the realification of an 
8-dimensional complex representation of Gr which is not of real type (indeed, in each case 
there exist two such representations and they are conjugate to one another). Since r is 
(SO(8, C), © C 8 _) (where C 8 denote the half-spin representations) with compact real 
form (Spin(8),R 8 © R 8 ) having the same orbits as (SO (8) x SO(8),R 8 © R 8 ), it follows 
that p has the same closed orbits as the standard action of (SO(8, C)) r on (C 8 ) r . Now the 
latter is a pseudo-Riemannian s-representation, so this case is also dealt with. 

(b.l ) Consider now the case in which p = p © p^, where p is absolutely irreducible and 
non-orthogonalizable. Then p c = p^ © (pg) c is polar and p$ is irreducible. By polarity, 
Pq and (pq) c = (Po)* are inequivalent, so p$ is not self-dual implying that it is not of real 
type with respect to U. Recall that (po)* is the conjugate representation p§ with respect 
to U. It follows that §(v',v") = (v",v') for (v',v") G V C © V Q C , the space W = {(v',v") E 
Vq © Vq : v ' = v"}, and r u : U —* GL(W) is irreducible, not absolutely irreducible, and 
equivalent to [PqY\u '■ U — > GL((VqY). In other words, W admits a ^/-invariant complex 
structure J and po is just a real form of the holomorphic extension of r u : U — > GL(W, J) 
to a representation of G on (W, J). By Lemma [H it suffices to consider the case in which 
t u is not an s-representation, namely, given in ([7]). We do only the case (SU(n), (A 2 C n ) r ) 
for n odd, the others being similar in spirit. Since n is odd, |Oni04t Table 5] gives that 
Gr = SL{n, R) and p is the representation on A 2 R n . Now p = Pq® Pq has the same closed 
orbits as (GL + (n, R), A 2 R™ © (A 2 R n )*), which turns out to be the s-representation of the 
pseudo-Riemannian symmetric space SO(n, n)/GL + (n, R) [Bcr57, Tableau II]. 

(b.2) Finally, suppose that p = p © Pg, where p is irreducible, not absolutely irreducible 
and non-orthogonalizable. Then p , p* can be viewed as complex representations, and p c = 
Po © Po © Po © Po is an irreducible decomposition with pairwise inequivalent summands, where 
Po (resp. po = Po) is the conjugate representation to po with respect to Gr (resp. U). We 
must have t u = (r u )i © (r u ) 2 : U — ► GL(W\ © W2), where (r u )i is polar irreducible, not 
absolutely irreducible. Moreover, n = po©Po an d r 2 = poffipo, where we have set n = (r u )f. 

(b.2.1) Suppose t u is splitting. Then U = U\ x U 2 and r u is the outer direct product of 
( t m)i|(7i an d (t u ) 2 \u2^ where each (tu)^. is irreducible and not absolutely irreducible. The 
automorphism o : U — > U must take U\ to U2, so we can assume JJ\ = U2 and (r u )i = 
( r u)2- Write G = Gi x G 2 where jjj = u^. Then p is equivalent to the realification of 
ti\gi '■ ^1 ~" *■ C-^(KT © K) C *); an< i t i|gi is the complexification of a polar irreducible, not 
absolutely irreducible representation (t^)^^ : Z7i — > GL{W\). We have only to consider 
the case in which it is not an s-representation, namely, given in (jTj). We do only the case 
(Spm(10), (C 16 ) r ), the others being similar in spirit. Here n is (Spin(10, C), C 16 ©C 16 *) and 
p is (iSpin(10, C) r , (C 16 ) r © (C 16 *) r ), which turns out to have the same closed orbits as the 
pseudo-Riemannian s-representation given by the realification of (C x x Spin(l0, C), C 16 © 
C 16 *). 

(b.2. 2) Suppose t u is not splitting. Then it is not almost splitting by the same argument 
as in case (a. 2. 2). Owing to the fact that (r u )j admits an invariant complex structure for 
i = 1, 2, we see from |GT00t p. 59] that this case is not possible. 
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4. Isoparametric submanifolds 



Let Vr be a finite-dimensional real vector space equipped with a non-degenerate symmetric 
bilinear form (■,•). A submanifold M of Vr is called a pseudo-Riemannian submanifold if 
the restrictions of (■,■) to the tangent spaces of M are always nondegenerate. If M is a 
pseudo-Riemannian submanifold, the canonical flat connection D in Vr induces the Levi- 
Civita connection V in M, the second fundamental form B of M, and the connection V -1 in 
the normal bundle uM of M in the usual way. Namely, 

D X Y = V X Y + B(X,Y), 

and 

D x t = -A t X + Vi^ 

where X and Y are sections of TM and £ is a section of z/M, and the Weingarten operator 
At. : TM TM is defined by 

(A e x,r) = ( J B(x,r),o. 

For each p G M, the map : T p M — > T p M is a symmetric endomorphism with respect 
to the induced inner product in T p M. Note that in the case in which this induced inner 
product is positive-definite, the Weingarten operator is automatically diagonalizable over R, 
whereas in the general case it may happen that A^\ p is not diagonalizable, not even over C. 

A properly embedded pseudo-Riemannian submanifold M of Vr will be herein called 
isoparametric if the following two conditions are satisfied: 

(a) the normal connection is flat; 

(b) the Weingarten operator along a locally defined parallel normal vector field is diago- 
nalizable over C with constant eigenvalues. 

Isoparametric submanifolds of Euclidean spaces are very important in submanifold geometry 
and share a very rich history and an extensive literature, see |Ter85j iThoOOl 030003] and the 
references therein. On the other hand, isoparametric submanifolds of indefinite space forms 
are not as common, but have already been considered before with different definitions, see 
e.g. [Hah84, Mag85 . Herein we consider a stronger definition which in our opinion seems 



more natural in view of Theorems [T] and [TTJ 

In this section, we will consider homogeneous isoparametric submanifolds. We start with 
the following lemma. 

Lemma 10. Let r : G — > 0(V, (•, •)) be a complex polar orthogonal representation of a 
complex reductive algebraic group. 

(a) For v G V, we have c v C (q ■ v) , and the equality holds if and only if v is regular. 

(b) If c C V is a Cartan subspace, then (c, Q ■ c) = 0. In particular, the restrictions of 
(-, ■) to c and g ■ v for regular v are nondegenerate. 

Proof, (a) If x G c v , then q ■ x C g ■ v , so 

(x,Q- v) = (q-x,v) = (q ■ v,v) = 

by G-invariance of (■,•), proving the inclusion. If v is regular, 

dimc„ = dimV//(j 

= dimV — max dim Gu (r is stable) 

= dim V — dim g ■ v, 
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and this shows that c v is the orthocomplement of g ■ v in V. 
(b) Follows from (a). 



□ 



Before stating the next theorem, a couple of remarks are in order. Let Gr be a connected 
real form of a connected complex reductive algebraic group G, let p : Gr — > GL(Vr) be an 
arbitrary real representation, and let r : G — > GL(V) be the complexification of p. If v G V 
is semisimple, then the isotropy subgroup G v is reductive; hence, there exists a G^-invariant 
subspace N v C V such that V = g-vQ)N v . The restriction of r to G v — > GL(N V ) is called the 
slice representation at v. IfvE Vr, then G v , N v and the slice representation are defined over 
R. There exists a Zariski-open and dense subset V pr of V such that all isotropy subgroups 
G v for semisimple v G V pr are in one conjugacy class |Sch80, Cor. 5.6]. A semisimple point 
v G Vp r is called principal. Every principal point is regular. We have that V pi D Vr is 
dense in Vr [Bre93l 13.4]. If v G Vr, then Gr1> is closed if and only if Gv is closed |Bir71j . 
and dimRGRf = dimGw; it follows that max u6 y R diniR Grv = max„ g y dimGf . Suppose 
now that p is orthogonalizable; then so is r, hence r is stable; in this case, V pr consists of 
semisimple elements only, and it follows from this discussion that V pr fl Vr is an open and 
dense subset of Vr consisting of closed GR-orbits. Suppose now, in addition, that r is polar. 
Since the slice representations of r are the complexifications of the slice representations of 
the real form t u : U -> GL(W) |Sch80l Cor. 5.9], it follows from |BCU03l Cor. 5.4.3] that 
Vp r is precisely the set of regular points of r. 

Theorem 11. Let p : Gr — ► 0(Vr, (•>•)) be an orthogonal representation. If p is polar 
then every orbit of p through a regular element v G Vr is isoparametric. Conversely, if p is 
irreducible and there exists a regular element v G Vr such that Gri> is isoparametric then p 
is polar. 

Proof. Suppose p is polar and v G Vr is regular. Then c v = (g • v) 1 - is a Cartan subspace 
of r = p c defined over R. Denote the set of real points of c v by (c„)r and let M = Grw . 
Then the normal space v v M = (c„)r. Since g v ■ c v = [DK85t Lem. 2.1(iii)], any £ G v v M 
extends to a locally defined equivariant normal vector field £ along M given by £(gv) = g^ for 
g G (Gr)° (the connected component of the identity). For X G 0r, we have that V~x. v i is the 
orthogonal projection in v v M of ^| i=Q (exptX)£ = X-£ G gR-£. Since 0r-£ C 0R-f, it follows 

that V^. w £ = 0. This proves that a locally defined equivariant normal vector field along M is 
parallel. By taking a basis of u v M, we get a locally defined parallel normal frame along u v M, 
which implies that v v M is flat. It is clear that the eigenvalues of the Weingarten operator 
along an equivariant normal vector field are constant, and that operator is diagonalizable 
over C by Example [T2l below. Hence M is isoparametric. 

Conversely, suppose p is irreducible and there exists a regular element v G Vr such that 
M = Grw is isoparametric. Irreducibility of p yields that M is full in Vr, that is, not 
contained in a proper afnne subspace. We first claim that a locally defined parallel normal 
vector field £ along M is equivariant. Let U be a neighborhood of v in M where £ is defined, 
and let £(v) = £. Suppose that g(t) is a continuous curve in Gr satisfying g(0) = 1 and 
g(t)v G U. Consider the continuous curve £(£) = g(t)~ 1 ^(g(i)v) in u v M. By the isoparametric 
condition and the fact that the action of Gr is orthogonal, we have that A^u) an d A^ have 
the same complex eigenvalues. By connectedness of the domain interval of g(t) and the facts 
that they are diagonalizable over C and commute, we get that A^ = A^ for all t. Fullness 
of M implies the injectivity of the map £ i— ► Ag, so £(t) = £ for all t. This proves the claim. 
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Since the locally denned equivariant normal vector fields are parallel with respect to the 
normal connection, 

X-£ = D X J = -Az{X ■ v) + VjtJ = -MX -v)egB.-v, 

where £ G v v M and X G 0r. This proves that v v M C (c 1 ,)r. Since 

diniR v v M = diniR Vr — diniR M = dim V — dim Gv = dim V//G, 

we get that dimc^ = dimV//G and hence t = p c (resp. p) is polar. □ 

Example 12. Let r : G — > 0(V, (-, •)) be a complex polar orthogonal representation and 
fix an orthogonal real form p : Gr — > 0(Vr, (•,•}) defined by (er, er). In this example, we 
compute the Weingarten operator of an orbit M = G^v for a regular v G Vr = V a . Let 
c be a 9- and a-stable Cartan subspace of r and consider the corresponding root space 
decomposition 

= m + $<* 

(see subsection 15 . 21 for the notation and terminology used in this example). By Proposition 
below, we may assume that v G c a . Let £ be a vector normal to M at v in Vr. Then also 
£Gc*. 

If a is a noncomplex root, a is cr-stable. We have (the superscript "T" denotes the 
tangential component to the orbit) 

A^X a -v) = ~(X a -0 T , 

where X a G and 

X a ■ v = a(v)X a -v a , X a -^ = a(£)X a ■ v a , 

so 

A^(X a ■ v a ) = A X a ■ v a (resp. A^(iX a ■ v a ) = A i(X a ■ v a )) 

where A = — ^j|y is a real eigenvalue and X a -v a (resp. i(X a -v a )) is the associated eigenvector 
if a is real (resp. imaginary). 

If a is a complex root, g a is not cr-stable and (g a © Q\ aa \) a is spanned by X a + aX a and 

i(X a — aX a ) for X a G g a . The associated subspace of T V M is spanned by 
(9) a(v)X a ■ v a + a(v )a(X a ■ v a ), % (a(v )X a ■ v a — a(v)a(X a ■ v a ) j 

for X a G g e a . 

Now A = — is not real and the matrix of in the basis is given by 

/ 3?A -3A \ 

V sa ka y ' 

which is of course diagonalizable over C. 
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5. Structural theory of polar representations of 
real reductive algebraic groups 

Consider a semisimple pseudo-Riemannian symmetric space Gr/Gr and its complexifi- 
cation G/G as in the first two paragraphs of section [31 Let a denote the conjugation of G 
over Gr. We can choose a Cartan involution 9 of Gr that commutes with f on Gr. Since 
G is simply-connected, we can extend 9 anti-holomorphically to a Cartan involution of G 
which will be denoted by the same letter. Note that 9 commutes with f and a on G. Set 9 
(resp. 9) to be the restriction of 9 to G (resp. V), and set a (resp. a) to be the restriction 
of a to G (resp. V). Then U = G e (resp. U = G e ) is a compact real form of G (resp. G). 
Write W = V e . Now we have the combined decomposition 

(10) R = (0rTVu + gRHju) + (Vr n W + Vr n zW). 

In this context, an element v G Vr is called semisimple if ad„ is a semisimple endomor- 
phism of 0, and a Cartan subspace of £)r is a maximal Abelian subspace of Vr consisting 
of semisimple elements. It is known that the Adc R -orbit of v G Vr is closed if and only if 
v is semisimple [ BH62| Cor. 10.3]; every semisimple element of Vr belongs to some Cartan 
subspace; every Cartan subspace of Vr is Ad(c R )°-conjugate to a ^-stable Cartan subspace; 
there exist finitely many Ad(G R )°-conjugacy classes of ^-stable Cartan subspaces in Vr; two 
such ^-stable Cartan subspaces are Ad(A' R )°-conjugate if and only they are Ad(G R )°-conjugate 
if and only they are Adc-conjugate [HHN099j. 

Throughout this section, we let r : G — ► GL(V) be a complex polar representation of a 
connected complex reductive algebraic group, consider a real form p : Gr — > GL(Vr) defined 
by (a, a), where Gr is the identity component of G a , and prove a collection of results for 
p similar to those stated in the previous paragraph for an s-representation. The first three 
results do not require that r and p be orthogonalizable. 

5.1. General facts about Cartan subspaces. A Cartan subspace of p is a subspace of 
V u which is the 5"-fixed point vector space of a a-stable Cartan subspace of r. 

Lemma 13. There exist a-stable Cartan subspaces of r. 

Proof. Owing to the remarks preceding Theorem [TTJ the set V pr R Vr is a nonempty open 
subset of Vr = V a consisting of regular elements of r; it suffices to take c v where v lies 
therein. □ 

We will use the following notion in the proof of the next proposition. The rank of r is 
defined to be the difference dime — dime 9 , where c C V is a Cartan subspace and c denotes 
the subspace of G-fixed points in c. 

Proposition 14. Given a semisimple x G V a ' , there exists a Cartan subspace of V a which 
contains x. 

Proof. Note that for a regular x G V a , one can simply take c = c x . In the general case, 
we proceed by induction on the rank of r. Since x is semisimple, there exists a Cartan 
subspace d such that x G d . If x G (c') B , then x belongs to any a-stable Cartan subspace 
of r. Suppose now x ^ (c') s . Then the slice representation (G x , N x ) is polar with rank stricly 
lower than r, and d C N x is a Cartan subspace of (G X ,N X ) [ DK85] Thm. 2.4]. Without 
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loss of generality, x is a minimal vector with respect to some [/-invariant positive-definite 
Hermitian form (•, •) which is real- valued on V u , and N x is the orthocomplement of Q ■ x 
with respect to (•, •) |DK85l Rmk. 1.4]. Since x G V a , it follows that G x is a-stable, N x is 
a-stable and (G x , N x ) is defined over R with respect to (a, a). By the induction hypothesis, 
there exists a a-stable Cartan subspace c C N x such that x G c. Now c, d are two Cartan 
subspaces of (G x , N x ), so there exists g £ G x such that g-d — c. It follows that c is a Cartan 
subspace of r. □ 

Theorem 15. There exist only finitely many G^-conjugacy classes of Cartan subspaces 
ofV R . 

Proof. According to the remarks preceding Theorem [TU the set of regular points of r is 
a Zariski-open and dense subset V pr of V. By a theorem of Whitney |Whi57j . V pr fl Vr has 
finitely many connected components. 

Suppose now that c a is a Cartan subspace of Vr,. Consider the map 

Gr X C a -> Vr, (0, u) h-> g ■ V] 

it is easily seen to be a smooth submersion at v if v is a regular point of r. It follows that 
Gn " (c CT H Vp r ) is open in Vr. But the sets Gr • (c CT fl V pr ) for varying c°" obviously cover 
Vp r PI Vr. Any two of them are not disjoint if and only if the corresponding Cartan subspaces 
are conjugate, in which case the sets coincide. The result follows. □ 

Consider the categorical quotient map n : V — ► V//G. Since G, V, and the action of G on 
V are defined over R, so is the variety V//G; denote its set of real points by (V//G)r. By a 
theorem of Tarski and Seidenberg, vt(Vr) is a real semialgebraic subset of {V//G)-r,. Recall 
that 7r(Vp r fl Vr) is an open and dense subset of 7t(Vr). We propose the following conjecture 
(compare [Rot71j ). 

Conjecture 16. The map ir sets up a one-to-one correspondence between the G^-conjugacy 
classes of Cartan subspaces o/Vr and the connected components of the stratum 7r(V^ r n Vr). 

Henceforth we assume that p (and hence r) is orthogonal with respect to (•,-). 

Theorem 17. (a) Given a a-stable Cartan subspace c C V, there exists a Cartan pair 
(77, fj) commuting with (a, a) such that c is fj-stable. 
(b) Given a Cartan pair (6,8) commuting with (o~,cr), every a-stable Cartan subspace 
c C V is (G a )° -conjugate to a 6-stable one (hence also a-stable). 

Proof. We begin by showing that there exists a Cartan pair (/z, p) of r such that p,(c) = c. 
Indeed, suppose (9', 9') is any Cartan pair. We can select v G V 9 ' regular. Since c meets 
all the closed orbits, there exists g G G such that g ■ v G c. Define fj, = Inn^'Inn" 1 

and fx = gO g' 1 . Then (/z, p) is a Cartan pair and jl(g ■ v) = g ■ v. Hence stable. 

The following construction of 77 is standard (compare |Oni04[ §3, Prop. 6]). Set u = a 11. 
We can view wasa complex linear automorphism of q. Consider the decomposition into the 
center and semisimple factor g = 3 © g ss . Let f3 be the Killing form of g ss . We can extend j3 
to an ad-invariant symmetric bilinear form on q, denoted by the same letter, which is real- 
valued on M , g a and negative-definite on q^. Then one easily sees that u is Hermitian with 
respect to the positive-definite Hermitian form B^(X,Y) = —j3(X, liY), where X, Y G g. 
It follows that uj 2 is Hermitian and positive-definite, and hence belongs to a one-parameter 
family of Hermitian and positive-definite automorphisms of q. Therefore there exists a unique 
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Hermitian, positive-definite automorphism p> of g such that p> A = u 2 . Since p>\ Sss belongs to 
a one-parameter group of automorphisms of g, we have that p\ Sss is inner, that is, equals 
Adh for some h G G ss . Set 77 = lnn h fi Inn^ 1 . Then 77 is a Cartan involution of G. Also, on 
the Lie algebra level, fiUfi = a; -1 , so /iu; 2 /i = a; -2 and fupfi = p^ 1 . Of course, ujuj 2 uj~ 1 = u 2 , 
so clX/xj -1 = p and cuy? 2 ^ -1 = ip 2 . Now we have 

770- = ipnip~ l G = ip 2 ficr = p> 2 uj~ l = uj^^-p 2 , 

ar\ = apfip" 1 = o[ip>~ 2 = cop~ 2 , 

so p A = ijj 2 implies that r/a = arj on 0, and also on G. 

For the next step, define Co = aft,. Then Co is a G-equivariant complex automorphism of 
V. Futher, Co is Hermitian with respect to the positive-definite Hermitian form B^(x,y) = 
— (x,fty) on V. It follows that Co 2 is Hermitian and positive-definite, so as above there is a 
unique Hermitian and positive-definite automorphism <p of V such that <p 4 = Co 2 . Setting fj = 
pftp^ 1 , we have that fja = afj by a computation similar to that in the previous paragraph. 
Moreover, 77(c) = c, because &{c) = c and ft(c) = c. We also have (x, y G V) 

(fjx, fjy) = (pftp^x, pftp~ l y) 
= {ftp^x.ftp^y) 
= (^x^^y) 
= (x,y) 

and, if ^ x G V*, 

(x,x) = (<p~ l x, p^x) 
<0, 

where we have used that (x, y G V) 

(<px,<py) = -B^px.ftpy) 

= -B-^px.p^fty) 
= -Bjx{x,fty) 
= (x,y) 

= {p^x, p>~ l y). 

In order to see that (77, 77) is a Cartan pair, it only remains to check that fj(g-v) = i](g)-fj(v) 
for g G G, v G V. It suffices to prove that p = r(h). Denote the induced representation 
g — > gl(V) by dr. Since Adh is Hermitian, positive-definite with respect to B^, the element h 
can be taken of the form exp Y, where Y G ig^ s . Then r(h) = e dr ( Y \ This implies that r(h) 
is Hermitian, positive-definite with respect to B^. Since (X G g) 

adriX)^ 1 = dr(aX) and ftdr^ft' 1 = dr(fiX), 

we also have that 

(11) CudT(X)Cu- 1 = dr(uoX). 

Since the irreducible summands of V must be pairwise inequivalent by polarity, each one of 
them is cD-invariant. Let V be an irreducible summand of V and suppose that the action of 
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{p- l x G V™) 



(ftipft = p l ) 
(p> is Hermitian) 



3 on Vo is given by a linear functional A : 3 — > C. 
for X G 3. Now, if X G 3 and t> G Vo, we have 

(12) T(hfdT(X)T(h)- A v = A(X)v = 



Equation flTTl) implies that A(X) = A(cuX) 
A(lu 2 (X))v = dr(u 2 (X))v, 



and if X G g ss , 

T(h) 4 dr(X)r(hy 4 = dr(Ad 4 h X) 
(13) = dr( V 4 (X)), 

= dr(u 2 (X)). 

Equations (fTTj) . (|T2|) and (TT3T) imply that cu 2 and t(/i) 4 are two intertwining maps between 
the representations dr and dr o oj 2 . It follows that they are multiples of each other on each 
irreducible summand. Since both maps are positive-definite, r(h) 4 = XCj 2 for A G R, A > 0. 
Since both are isometries with respect to (•,•), one has A = 1. Now (a) is proved. For 
proving (b), construct (r/, fj) as in (a) and note that it is conjugate to (9,9) by an element 
g' G (G a )° by Corollary HI Now c' = g' ■ c is a ^-stable Cartan subspace. □ 

In case a Cartan pair (6, 9) commuting with (a, a) is fixed, a ^-stable Cartan subspace of 
p will sometimes be called standard. 

Corollary 18. If (9, 9) is a Cartan pair commuting with (cr, a), then every closed (G a )° -orbit 
in V a intersects a standard Cartan subspace of V a . 

Proof. Suppose that (G a )°x is a closed orbit in V° ' . By Proposition [HJ there exists a 
cr-stable Cartan subspace c C V such that x G c CT . By Theorem [T71 there exists g G (C 7 ) 
such that g ■ c is a o- and ^-stable Cartan subspace. Of course, (G u )°x meets g ■ c. □ 

5.2. Roots and co-roots. In the rest of the paper, we assume that p is orthogonal with 
respect to (-, •) and a Cartan pair (9,9) commuting with (a, a) has been fixed according to 
Proposition^ We also recall the Hermitian form (-, ■) that was introduced in that proposition 
and satisfies equation ([TJ). 

For a given Cartan subspace c C V, the set of singular elements c sing C c is by definition 
the complement of the set of regular elements in c. If the rank of r is not zero, it is known 
that c S i n g is a union of finitely many complex hyperplanes 

Csing Qj, 

a€s>/ 

where is a finite index set pDK85j Lem. 2.11]. Fix a a- and ^-stable Cartan subspace 
c C V, set g a to be the centralizer of c a in g and G a to be the corresponding connected 
subgroup of G. 

Lemma 19. We have that {g a • c, Qp • c) — for a 7^ (3. 

Proof. It follows from Lemma [TU] that c C (q ■ v ) ± for 06 c. Since ($j • v) 1 - is g^-invariant, 
this implies (q v ■ c, g ■ v) — 0. In particular, if v G c a \ Up^aCp, then q v = Q a [DK85j p. 516], 
so (g a ■ c, Q ■ v) = implying that (g a ■ c,Q- c a ) = 0. Since ■ c C g ■ c a for a 7^ (3 [DK85j 
p. 517], the desired result follows. □ 

Lemma 20. Each c a meets V ±e in a real hyperplane. 



Proof. It is equivalent to prove that each c a is ^-stable. Of course, (■, ■) is nondegenerate 
on c a x c a as (■, ■) is positive-definite. Choose v a G c to be (■, -)-orthogonal to c a . We claim 
that the decomposition c = c a © Cv a is (•, •) -orthogonal. Since (x,9y) = — (x,y) for x, 
y G V, this will prove the desired result. In order to prove the claim, note that c © g a ■ c 
is a G Q -invariant subspace |DK85l Thm. 2.12(H)] and (•, •) is nondegenerate on c © Q a ■ c 
by Lemmas [10] and \T9\ Since G a acts trivially on c Q and g a • c = g a • v a , it follows that 
c a © C^q, © Q • f Q is (•, -)-orthogonal. □ 

Since (•, •) is positive-definite on V~~ e x V~ e , the vector v a in the proof of Lemma [201 can 
be chosen to satisfy 

v a G V~ e , (v a ,c~ 9 ) = and (v a ,v a ) = 1, 

and then it is uniquely defined up to a sign. We select a connected component of c~ e — 
U a £s;fC~ once and for all, and then v a is uniquely defined (but the sign of v a will not 
actually matter for our purposes). The vector v a is called a (unnormalized) co-root. The 
associated root is the linear functional a : c — > C obtained by setting 

a(f ) = (f , i> a ) G R 

for i> G c~ 9 and then considering its complex- linear extension to c. A root is called: real 
(resp. imaginary) if a is real-valued (resp. purely imaginary-valued) on c CT , and it is called 
complex otherwise. It follows from the (•, ■ )-orthogonality of the decomposition c~ e = c u H 
c~ e © c~ a n c -61 that a is real (resp. imaginary) if and only if it vanishes on c~°" D c -61 
(resp. c CT fl c" 61 ), in which belongs to c u fl c 61 (resp. c CT fl c e ). It follows that a in 

noncomplex if and only if c a is a-invariant if and only if it is d)-invariant, where Co = oQ = 6a. 
Recall that 6 gets replaced by its opposite by changing the sign of (-, •), so the choice of some 
signs above does not have intrinsic meaning, as compared to the case of an s-representation 
in which the sign of (■, ■) is fixed by the Killing form of g R (see ( llOp ). 

Let m be the centralizer of c in jj. Then m is a-, ^-stable. Since m is a reductive subalgebra 
of g a , there exists a 9- and ad m -stable splitting 

where Q a is a subspace, which is called a root space. Now assume a is noncomplex. Then $j Q 
can be taken cu-stable, so that g a = Qa^Qa^- ^ n imaginary root a G srf is called noncompact 
imaginary if ^ and compact imaginary otherwise. A real root a G is called compact 
real if 7^ and noncompact real otherwise. Finally, define 

aa{v) = a(av), 

where v G c. Since a takes singular orbits to singular orbits and maps hyperplanes of c to 
hyperplanes of c, this defines an action on srf U (—&/). Also, a a = a (resp. a a = —a) if and 
only if a is real (resp. imaginary). We can choose the root spaces so that o~Q a = S\a<x\ f° r an 
a G s$ ', where | • | : stf U (— stf) — > srf has its obvious meaning. 

5.3. Cayley transforms. By Corollary [18] every closed G^-orbit in Vr meets some stan- 
dard Cartan subspace of Vr,. We want to study standard Cartan subspaces of Vr,, so consider 
a b- and ^-stable Cartan subspace c C V. Note that 

c d = c d r\c e ®c d r\ c~\ 
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and dim R c a fl c 9 (resp. dim R c a PI c~ 9 ) is an invariant of the GR-conjugacy class of c CT , called 
the compact dimension (resp. noncompact dimension) of c a . We call a standard Cartan 
subspace c a maximally compact (resp. maximally noncompact) if its compact dimension 
(resp. noncompact dimension) is as large as possible. Note that the compact and non- 
compact dimensions of c a are interchanged if we replace (•, •) and 9 by their opposites. A 
maximally compact or maximally noncompact standard Cartan subspace will also be called 
extremal. Cayley transforms are used to pass from one GR-conjugacy class of Cartan sub- 
spaces to another one, namely, to increase or decrease its compact dimension by one (and 
correspondingly decrease or increase its noncompact dimension by one). In general, an el- 
ement g G G maps a a- and ^-stable Cartan subspace c of V to another a- and ^-stable 
Cartan subspace if and only if a(g)g~ 1 and 0{g)g~ x belong to the normalizer Nq{c) of c in 
G, as is easily seen. Recall that the Weyl group of c is the finite group |DK85l p. 513] 

W(c) = N G (c)/Z G (c), 

where Zg{c) denotes the centralizer of c in G. We will construct a special kind of Cayley 
transform. We first consider the case of a rank one polar orthogonal irreducible representation 
t : G —>■ 0(V, (•, •)). Fix a standard Cartan subspace c which is extremal, say maximally 
compact. Here c CT = c a fl c e and stf = {«}. Assume that a is an imaginary root. We will 
show how one can pass from c a to a Cartan subspace c in another GR-conjugacy class which 
in this case, by dimensional reasons, must be maximally noncompact, namely, c a = <z a fl cr e . 
Since the rank is one, t u : U — > 0(W, (-, •)) is a co-homogeneity one action of a compact Lie 
group. Let v = iv a G c a fl c 6 . Then (v,v) = —1 and U(v) is a round sphere S^ 1 ~ U/U v 
in W. Introduce the following notation: g = £ + p is the decomposition into ±l-eigenspaces 
of u>, 6r = t a = t e , p R = p CT , and = U a = U fl Gr; note that K-r, is a maximal compact 
subgroup of Gr and hence it is connected since Gr is so. 

Claim 1. We have that a is compact imaginary if and only if C U is transitive on S*" --1 . 

In fact, here we have g a = m © Q a where Q a = g, m = Q v , and g = q v © g a is ^-stable. 
Taking #-fixed points, we get u = u v (B Q e a - Now Kr is transitive on S"™ -1 if and only if 
u„ + €r = u if and only if £ R D if and only if t D g a if and only if g~ w = {0}. 

Claim 2. // i^R is not transitive on S 1 ™ -1 , then we can take g G G sitc/i £/ia£ #(g) = g, 
a(g) = g^ 1 and g 2 = —id G W(c). 

Indeed, the assumption is equivalent to g^ fl g~ a ^ {0}; take a nonzero X therein. We 
can choose X so that j(t) = exptX ■ v is a unit speed geodesic of S" -1 connecting 7(0) = v 
to 7(71") = — f . Set <? = exp |A G ?7. Clearly, 9(g) = g. Also, a(g) = g" 1 , and g 2 ■ v = 
exp7rX • v = —v, so g 2 = —id on Cv = c. 

Claim 3. If g is as in the previous claim and c — g-c, then c a is a maximally noncompact 
Cartan subspace of V a . 

In fact, 0(g)g~ l = id and c^g' 1 = g~ 2 = —id both belong to W(c), so c is a- and 
^-stable. Also, 

a(gv) = a(g)a{v) = g^v = -g~ 1 g 2 v = -gv, 

so 

c a = H(igv) and 6{igv) = —i9(g)8(v) = —igv. 
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We have shown that in the rank one case, associated to a noncompact imaginary root a, a 
Cayley transformation c a = r{g) can be constructed so that it maps a given a- and ^-stable 
Cartan subspace c to a a- and ^-stable Cartan subspace c = c a (c) such that the noncompact 
dimension of c a is one higher than that of c a '. In the sequel, we want to generalize this 
construction to an arbitrary polar orthogonal representation r : G — » 0(V, (•, ■)). 

Indeed, suppose now that the rank of r is arbitrary, let c be an arbitrary a- and ^-stable 
Cartan subspace and assume there exists a noncompact imaginary root a G s$ which we 
suppose fixed. Write c = c a @ Cv a where v a G i{c a fl c e ) = c~ a fl c~ 9 is the co-root. Note 
that 

c a = ££©R(iv a ), 

and zu a G c e . Now (g a , c © g a ■ c) is a rank one polar action |DK85j Th. 2.12]. Since 
^ Q a ■ c is a (-, ^-orthogonal direct sum, (g Q , c©g a ■ c) is orthogonal with respect 
to the restriction of (-, •); we restrict it to (g a ,Cv a © g a ■ v a ) to get an irreducible polar 
orthogonal action of rank one. Since X G Q a i— > X ■ v a is injective on g a , the kernel of this 
representation is contained in m. Let Z G m. Then Z • v a — 0. If Z • a ■ u a = 0, then 
[Z, Q ] • u a = 0. Since [Z, g a ] C g a , we get that [Z, g Q ] = 0, so Z G Z m (g a ). Now (fl' a , V^) is 
an effective irreducible polar orthogonal action of rank one, where we have set 

= g a /Z m (g Q ) and V a = Cv a ®g a -v a . 

Note that a can also be considered as a root of (g' a ,V a ), and then it is a noncompact 
imaginary root, so by the previous discussion we can find g G G a as above and perform a 
Cayley transform c a = r(g) as follows: 

C = C a (c) = C a © C(0V a ). 

Note that 

and ^t> Q G c~ e , so the noncompact dimension of c a is one higher than that of c a . In a 
completely analogous way, one can define a Cayley transform that increases the compact 
dimension of c a by one by using a compact real root. 

5.4. Uniqueness of extremal Cartan subspaces. The Cayley transform allows us to 
derive some important properties of extremal Cartan subspaces. 

Theorem 21. We have that (/Cr, Vr fl iW) (resp. Vr, D W) ) is a polar representation. 
The sections are given by c a fl c~ e (resp. c a r\c e ), where c a is a maximally noncompact 
(resp. compact) Cartan subspace o/Vr = V a . 

Proof. It suffices to treat the case of (K^, fl iW). Let c a be a maximally noncompact 
Cartan subspace. Then there are no noncompact imaginary roots, for otherwise a Cayley 
transform could be performed increasing the noncompact dimension of c a . We claim that 
there exists v 2 G c a fl c~ e such that 

tn(v 2 ) © <f n c- § = v a n v~ § = v R n iW. 

In order to prove this claim, we first remark that |DK85l Thm.2.12] 

Qv = m + Yl fla 

a(u)=0 
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for v G c, 



and 



., = , m + Ea imag Qa for generic f 6 c 
V I m + E a real 0« for generic v 6c u , 

= ( mW + 0a I © ( + JC I for generic v x G c* n c 9 , 

a real / \ a real / 



Ct Cp 



\ a imag / 



)^rv^, for generic v 2 G c CT fl c e , 



ce 

where in the last line we have used the nonexistence of noncompact imaginary roots. Select 
generic v i G c CT fl c 9 , v 2 G c CT fl c - " and set t> = v i + t> 2 G c CT . For each a G 

a(-y) = a(-ui) + a(w 2 ), 

GiR GR 

where at least one of the two summands on the right hand-side in not zero by the choice of 
v 2 . This shows that v is regular for (G, V). By polarity g ■ v © c = V. Taking real parts 
in Vr yields 

0r(u) © = Vr, 

which is the same as 

(*r(ui) + PrM) © (*rM + Pr(«i)) © c" n c e ~ © <? n c- e " = Vr n VF © Vr n iW. 
In particular, 

(W^) + Pr(ui)) © c* n c~ e ~ = Vr n iW. 
The claim will follow if we show that tn(v 2 ) D Pr(^i)- This is to be a consequence of 
t ■ v 2 D p • v\, as t ■ v 2 and p • v\ are cx-stable and £r(i>2) = (t • v 2 ) a , Pr,(i>i) = (p • vi) a . 
Now p • v 1 is spanned by 

-vi for a imaginary, and 

=0 

(X a - ujX a ) ■ vi = X a ■ v 1 - u(X a ■ v 1) 

= a(vi)(l — Cj){X a • v a ) for a complex and X a G Q a . 

On the other hand, t{v 2 ) is spanned by 

Qa ' v 2 f° r a real, and 

(X a + LoX a ) -v 2 = X a -v 2 - oj(X a ■ v 2 ) 

= a(v 2 )(l — oj){X a • v a ) for a complex and X a G g a . 

This proves that p-v\ C t-v 2 , and hence that 6r(i'2)©c <t fl c~ e = VrCMW. Since (q • c, c) = 0, 

we get that c u fl c~ e is the (•, -)-orthogonal complement of Kn(v 2 ) in Vr fl iW. Since Kn 

is compact and (•, •) is positive-definite on Vr fl iW, it easily follows that c a fl c~ 9 meets all 
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the i^R-orbits in Vr fl iW. Again by (g • c, c) = 0, one has that c a fl c 9 meets all the other 
i^R-orbits orthogonally. This finishes the proof. □ 

Corollary 22. Two maximally noncompact (resp. compact) Cartan subspaces c\ and c% of 
V a = Vr are Kr- conjugate. As a consequence, there exists a unique G-R-conjugacy class of 
maximally noncompact (resp. compact) Cartan subspaces o/Vr. 

Proof. Again, it suffices to treat the case of maximally noncompact Cartan subspaces. By 
Theorem (2TJ we may assume that 

c\ n c[ e = 4 H c 2 6 '. 

Take a generic point v 2 lying therein. Since v 2 G V-rCiHY, we have that u„ 2 = (6r)„ 2 + (ipn)v 2 j 
and this is a decomposition into the ±l-eigenspaces of a on u V2 , so 

(U V2 )° = (K R ) V2 exp[(ip R ) V2 \. 
Consider the slice of the polar action (U, V~ e ) at v 2 \ it is also polar with the same sections: 

cf = cf n cf e © cf n cf e 

for i = 1, 2. Now cf 9 and c^ 6 * must be conjugate by an element of (£/„ 2 )°. Since exp[(ip R )„ 2 ] 
centralizes c (for (^Pr)^ = m _ff rim e ), they must indeed be conjugate by an element of (Kr) V2 
(which necessarily fixes c\ fl c{ e = fl c^ e since this is a section of (-R'r, Vr fl iW) and t> 2 is 

a regular point of that action). Hence, so are c\ flcf = i^flq ) and c 2 r\c\ = i(c 2 ° nc 2 fl ). 

□ 
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